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METHOD AND APPARATUS FOR COMBINING 
VIDEO SIGNALS TO ONE COMPREHENSIVE 

VIDEO SIGNAL 

5 

CROSS REFERENCE TO RELATED APPLICATION 

This application claims the benefit of priority to Swedish Application No. 
0300286-2, filed on February 5, 2003, entitled "Method and Apparatus for Combining 
Video Signals to One Comprehensive Video Signal and prior filed co-pending 
10 Provisional Applications No. 60/462,041, filed on April 10, 2003 entitled "Method and 
Apparatus for Combining Video Signals to One Comprehensive Video SignaP (Atty. 
Docket # AWAPP008P) which are incorporated herein by reference in their entirety as 
if fijlly set forth herein. 

15 Technical field of the invention 

The present invention relates to a method and an apparatus for combining a 
first video signal with a second video signal, wherein said video signals represent video 
images and wherein at least the first video signal represents a moving picture. Further, 
the present invention relates to a video signal, wherein each pixel of a video image of 
20 said video signal is represented by a luminance value and chrominance values. 



Background of the Invention 

Means for combining or merging two or more video signals into one video 
signal is known in the art. For instance, such technique is normally used in motion 
25 pictures or in television recordings for placing a foreground object or person in an 
environment that is different fi-om the environment of the recording of the object or 
person. 

Normally, such prior art means utilises a technique called colour-keying. In a 
simple form of colour-keying the foreground object or person is recorded, foreground 
30 recording, in fi-ont of a screen that is coloured by a single colour, usually blue or green. 
A second recording of the desired background is also made. Then, by checking the 
colour of the foreground recording, switching between two video signals representing 



AWAPP008 



Page 1 of 21 



Patent 

the two recordings, respectively, may be performed based on the colour information of 
the foreground recording in order to combine the two recordings. When the colour of 
the screen in the foreground recording is detected the background video signal is 
switched into the video signal representing the combined video signal and when the 
5 colour of the screen is not detected in the foreground recording, the foreground video 
signal is switched into the video signal representing the combined video signals. 

Colour-keying is a widely spread technique for combining two video signals 
and it may be used both on recorded and live video. 

However, a colour-keying system requires that a specific colour in the 

10 foreground video signal is reserved as a replacement signal. Thus, this reserved colour 
may not be present in any part of the foreground that is not to be replaced by the 
background recording. This limits the number of allowed colours in the foreground 
recording and results in that a user has to make arrangements to prevent the reserved 
colour fi-om turning up in the portions of the recording that should not be replaced. 

15 In US 5 566 251, describing a system for deriving a composite video image by 

merging video image data firom a plurality of separate video signal sources, a technique 
different fi'om colour-keying is used. In said system an operator designates an arbitrary 
target pattern, for example a logotype pattern on a billboard, in one video sequence. 
The system then monitors that video sequence continuously and in every video image 

20 of the video sequence that the logotype pattern is found the system replaces the 
logot5q>e pattern with a video image data fi*om another video signal source. 

More specific, the system according to US 5 566 251 searches for the logotype 
pattern and when found estimates the orientation, scale, perspective distortion etc. of 
the logotype pattern. These estimates are then applied to the video image data fi*om the 

25 other video signal source in order to make the video image data of the other video 
signal source appear in the composite video image in a way corresponding to the 
appearance of the logotype pattern. 

This system is very complex to implement and requires a lot of processing in 
order to detect the arbitrary logotype pattern and to estimate the orientation, scale, 

30 perspective distortion etc. 



SUMMARY OF THE INVENTION 

It is an object of the present invention to present means for enabling simple 
and qualitative merging of two video signals into one video signal. 
35 This object is accomplished by means of a method according to claim 1 or 7, 

by means of an apparatus according to claim 12 and by means of a video signal 
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according to claim 16. Preferred embodiments of the invention are disclosed in the 

dependent claims. 

In particular, according to first aspect of the invention, the object is 

accomplished by means of a method for combining a first video signal with a second 
5 video signal, wherein at least the first video signal represents a sequence of video 

images. The method comprises the act of replacing image data in the second video 

signal with corresponding, in respect of a position within an image, image data fi'om 

the first video signal when said image data in the second video signal includes a 

predefined repetitive pattern. 
10 According to another aspect of the invention, the object of the invention is 

accomplished by means of a method for combining a first video signal and a second 

video signal into a third video signal, wherein each video signal represent a video 

image and wherein at least the first and third video signals represent a sequence of 

video images. The method comprises the acts of: 
15 receiving said first video signal fi-om a first source, 

receiving said second video signal fi'om a second source, 

detecting whether image data in a predetermined number of pixels of said 

second video signal correspond to image data in pixels of a predefined repetitive 

pattern, and 

20 if the image data in the predetermined number of pixels do not correspond to 

image data in the pixels of the predefined repetitive pattern, then outputting a portion 
of said second video signal that corresponds to said predetermined number of pixels, or 
if the image data in the predetermined number of pixels do correspond to image 
data in the pixels of the predefined repetitive pattern, then outputting a portion of said 

25 first video signal that corresponds, in respect of position within an image, to said 
predetermined number of pixels. 

According to yet another aspect of the invention, the object is accomplished by 
means of an apparatus for combining a first video signal with a second video signal, 
wherein said video signals represent video images and wherein at least the first video 

30 signal represents a sequence of video images, said apparatus comprising: 

i) a first input for input of the first video signal, 

ii) a second input for input of the second video signal, 

iii) an output for output of a third video signal, 

iv) a keying-pattem detector connected to said second input for detecting a 
35 predefined repetitive pattern, wherein said keying-pattem detector comprises: 

a means for receiving and/or storing a representation of the predefined 
repetitive pattern, and 
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an output that is arranged to provide a signal indicating whether said 
predefined repetitive pattern is detected or not, and 

v) a video switch connected to said first input, said second input, said output 
and said output of the keying-pattem detector for continuously selecting a video signal 
5 fi*om one of the first and second input to be represented in a third video signal, said 
selection being controlled by a signal fi-om the output of the keying-pattem detector. 

According to a fiirther aspect of the invention, the object is accomplished by 
means of a video signal, wherein each pixel of a video image of said video signal is 
represented by a luminance value and two chrominance values. The video signal 
10 comprises: 

a digitally generated background, in which the luminance values of the pixels 
are defining a predefined repetitive pattern, and 

a digitally generated video graphic foreground. 

By using a predefined repetitive pattern to define the area of a video image that 

15 is to be replaced, all available colour levels and/or luminance levels, in the processed 
video images, may be allowed in any of the video images of the two video signals that 
are to be combined. The risk of getting any strange combination distortions in the 
resulting video image of the resulting video signal because the keying-colour being 
present in areas not to be combined is also reduced by the use of the predefined 

20 repetitive pattern, without the need of limiting the number of colour levels and/or the 
number of luminance levels. 

Further, the process or means for determining whether to replace a portion of 
the second video signal with the first video signal or not, or whether a portion of the 
second or the first video signal are to be included in the resulting combined video 

25 signal, may easily be implemented, because only a portion of the pattern that are to be 
replaced has to be recognised at a time. Thus, the disadvantages of a colour-keying 
system may be overcome by using means that is not as sophisticated and complex as 
the means that has to be used in order to provide a system according to US 5 566 25 1 . 
In the context of this invention a video signal is defined as a signal carrying 

30 image data representing at least one video image. 

According to one embodiment of the invention the predefined repetitive 
pattern, which indicates that a portion in the video image of the second video signal is 
to be represented by the corresponding portion of the first video signal, is formed by 
consecutively arranged identical sub-patterns including a predetermined number of 

35 pixels. Accordingly, the act of detecting the predefined repetitive pattern in the second 
video signal is performed by reading a predetermined number of pixels fi-om the second 
video signal and by comparing said read predetermined number of pixels with a keying- 
pattem including at least one sub-pattem. 



AWAPP008 



Page 4 of 21 



^ Patent 

By using a predefined repetitive pattern that is formed by said identical sub- 
patterns, which sub-patterns are defined at a pixel level, for identifying the portion or 
portions of a video signal to replace, the act of or the means for combining the video 
images of the two video signals may be made simple and precise. Further, the 
5 complexity of the system for detecting the predefined repetitive pattern may be 

downscaled to a system that detects and replace one sub-pattern at a time instead of 
searching for an object occupying a rather large portion of the video image or, even 
worse, searching for said object in every consecutive video image in a sequence of 
video images. However, the system may also be designed to recognise a plurality of 

10 sub-patterns at a time and still present the above mentioned advantages. 

Additionally, the system according to this embodiment may result in a rather 
fast combination procedure, which may be advantageous in real time applications, 
because of the possibility of performing the detection and replacement of the 
predefined repetitive pattern without having to store essentially an entire image in 

15 order to analyse the data of the image. 

Further, if the second video image is generated by means of a video graphics 
generator, a precise version, on a pixel level, of the predefined repetitive pattern may 
easily be provided in the second video image. Thus, making it easy to detect the 
predefined repetitive pattern, because there is no need for the means detecting said 

20 pattern to consider any other representation than an exact replica of said pattern. 
Accordingly, values of pixels may be directly tested against the values of pixels in a 
keying-pattem. 

According to another embodiment the predefined repetitive pattern is provided 
in data of the second video signal representing the luminance of the video image, e.g. if 
25 the data defining a pixel of the video image includes a luminance value and two colour 
values, the predefined repetitive pattern is provided in the luminance values of the 
pixels forming the video image. 

By providing the predefined repetitive pattern in the luminance values of the 
video image and by detecting the same during the process of combining the two video 
30 signals the risk of getting strange combination distortions in the video image of the 
resulting video signal may be reduced even fiirther. 

Further, when combining chroma sub-sampled video images using some prior 
art methods/systems the resulting video image may show strange colour effects. These 
effects results from the fact that some pixels in a chroma sub-sampled image only 
35 carries data relating to luminance. This problem may be solved by providing and 
detecting the predefined repetitive pattern in the luminance values of the pixels 
representing the video image of the video signal. 
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Additionally, by implementing this embodiment of the invention the complexity 
of the system or process of combining two video signals may be reduced still more. 
This may be achieved by implementing the system or process to provide means only for 
detecting the predefined repetitive pattern in the luminance value of the pixels of the 
5 video image. 

A further scope of applicability of the present invention Avill become apparent 
fi-om the detailed description given below. However, it should be understood that the 
detailed description and specific examples, while indicating preferred embodiments of 
the invention, are given by way of illustration only, since various changes and 
10 modifications within the spirit and scope of the invention will become apparent to 
those skilled in the art from this detailed description. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Other features and advantages of the present invention will become apparent 
15 from the following detailed description of a presently preferred embodiment, with 
reference to the accompanying drawings, in which 

Fig. 1 illustrates a prior art system for combining video signals using colour 

keying. 

Fig. 2 schematically illustrates an embodiment of a system for combining video 
20 signals using the invention. 

Fig. 3 shows a schematic block diagram of a video graphics generator in 
accordance with an embodiment of the invention. 

Fig. 4 shows a schematic representation of an image which may be used in 
order to achieve the combined video signal according to one embodiment of the 
25 invention. 

Fig. 5a-d illustrates examples of sub-patterns that may be used in a predefined 
repetitive pattern according to the invention. 

Fig, 6a-c illustrates examples of diflferent sub sampling strategies. 

Fig. 7 illustrates the form and data of a sub-pattern in accordance with one 
30 embodiment of the invention. 

Fig. 8 shows a schematic block diagram of a keying-pattem detector in 
accordance with one embodiment of the invention. 

Fig. 9 shows a schematic diagram of the logic of a specific embodiment of the 
keying-pattem detector according to Fig. 8, and 

35 Fig 10 shows a schematic block diagram of a video combining device and a 

flowchart of a process of a keying-pattem detector in accordance with one 

embodiment of the invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

In Fig, 1 , an example of a prior art colour-keying system for combining two 
video signals is shown. The system includes a video camera 102 for recording of a 
background 104, a video camera 106 for recording of a foreground 108, a video 
5 switch 110 for switching between a background video signal 112 and a foreground 
video 1 14 signal generating a single video signal 116 representing a combination 118 
of the foreground 108 and the background 104, and a colour detector 120 controlling 
the video switch 110. 

A foreground setting 108 is arranged. The background in the setting 108, i.e. 

10 the areas 1 14 of the setting that are to be replaced in the final video sequence, are 

painted or in any other way provided with a single colour. Normally the areas that are 
to be replaced are coloured blue. Then the objects or persons 116 that are to be visible 
in the final video sequence are recorded in fi-ont of the single coloured background by 
means of the camera 106. Then the video signal 1 14 representing the recorded 

15 foreground video sequence is sent to the video switch 110. 

Additionally, a background setting 104 is arranged or selected. The background 
setting 104 is recorded by means of camera 102. Then the video signal 112 
representing the recorded background video sequence is sent to the video switch 110. 
The foreground video signal 1 14 is also provided to the colour detector 120. 

20 The colour detector 120 is arranged to detect, in the foreground video signal 1 14, the 
presence of areas of the recorded foreground video sequence that have said single 
colour. When said single colour is detected, the colour detector sends a signal 122 to 
the video switch 110 telling the video switch to forward image information fi-om the 
background video signal 112. When said single colour is not detected, the colour 

25 detector sends a signal 122 to the video switch telling the video switch to forward 
image information fi-om the foreground video signal 114, Thus, the resulting video 
signal 1 16 is formed by a combination of the foreground video signal 1 14 and the 
backgroimd video signal 1 12 and results in a combined video sequence 118. The 
resulting video sequence may then be recorded on tape, broadcasted live, stored on a 

30 server, etc. 

This system and method for combining video sequences are commonly used in 
television broadcasts and in motion pictures in order to position a reporter or a 
character in an environment that is not available for practical or technical reasons. 

The above mentioned system and the constructional details of such a system are 
35 known to a person skilled in the art. 

In Fig. 2, a system according to the invention is shown. The system comprises a 
camera 202 for recording a video sequence of a background 204, an event 204, or 
occurrences at a specific site 204. The camera 202 may be a studio camera, a handheld 
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video camera, a surveillance camera, a web camera, etc. Further, the system comprises 
a video graphics generator 206 generating a digital graphic overlay 222 to be 
positioned on top of the video sequence recorded by the camera 202, a video 
combining device 210. The video combining device 210 comprises a video switch 1 10 
5 for switching between a camera video signal 212 and a graphics video signal 214 in 
order to generate a combined video signal 216, and a keying-pattem detector 218 
controlling the video switch 1 10 by sending a control signal 220 to the switch. The 
camera video signal 212 and the graphics video signal 214 are preferably digital video 
signals, e.g. video signals according to the standards of CCIR (Consultative Committee 

10 for International Radio), ATSC (Advanced Television Systems Committee), or any 
other available digital video fromat. 

The video graphics generator 206 is arranged to generate video graphics 222 
that are to be positioned on top of the video sequence recorded by the camera 202. For 
example, the video graphics 222 may be a date, a time, a logotype, a name, information 

15 regarding settings of the camera or other equipment, other information, animated 

objects or persons/characters, etc, or any combination thereof. The background of the 
video graphics, i.e. the areas of the video graphics that are to be replaced with the 
video sequence of the camera 202, are indicated by a predefined repetitive pattern 224 
in the video graphics 222. 

20 The pattern may be formed by at least one sub-pattern which is defined at a 

pixel level and which is consecutively repeated for forming said predefined repetitive 
pattern 224. The video graphics 224 may be a sequence of images, i.e. animated. For 
example may information be continuously updated in consecutive images or may a 
logotype, object or person/character be animated. According to another embodiment 

25 the video graphics may be a still image. 

The video graphics generator 206 convert the video graphics 222 to said 
graphics video signal 214 and provide the signal 214 to the video switch 110 and the 
keying-pattem detector 218 of the video combining device 210. 

Said video graphics generator 206 may be an embedded processor system 

30 arranged to automatically generate the video graphics 222 firom received information, 
such as time values or other data, and/or text strings. It may also be a laptop computer, 
a desktop computer, or any other device capable of generating said video graphics 
having a predefined repetitive pattern 224, see also the paragraphs below presenting 
more detailed information regarding possible video graphics generators. 

35 The camera 202 is arranged to provide said camera video signal 212, 

representing a sequence of image fi*ames, to the video switch 110. 

The keying-pattem detector 218 receives the graphics video signal 214 and 
compare the contents of the graphics video signal 214 with a representation of a 
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reference pattern, which may correspond to at least one sub-pattern of the predefined 
repetitive pattern 224. If the contents of the graphics video signal corresponds to the 
reference pattern, the keying-pattem detector 218 sets the control signal 220 to a state 
that makes the video switch 110 forward the camera video signal 212 . If the contents 
5 of the graphics video signal does not correspond to the reference pattern, the keying- 
pattem detector 218 sets the control signal 220 to a state that make the video 
switch 110 forward the graphic video signal 214. The reference pattern is also called 
keying-pattem because it represent the pattern that is arranged to key the camera video 
signal 212 into the resulting video signal 216. 

10 The video switch 110 may operate in the same way that a prior art video 

switch, passing through image data firom one of two video signals 212, 214, depending 
on the value/state of a control signal 220. By making the keying-pattem detector 218 
control the switch and by providing a predefined repetitive pattern in the video 
graphics, the combined video signal 216 may be made to represent a sequence of 

15 images 226 in which each image includes a portion of each image of the image 

sequence recorded by means of the camera 202 and a portion of each image of the 
image sequence generated by means of the video graphics generator 206. 

The combined video signal 216 may then be forwarded to a device or an 
application having network server functionality in order to prepare the video signal for 

20 transfer to viewing devices via a network, e.g. the network may be a computer 

network or a surveill2mce network, to an internal display of a device comprising the 
video combining device 210, to a recording equipment for storing the image sequence 
of the video signal, etc. The resulting video sequence may then be recorded on tape, 
broadcasted live, stored on a server, etc. 

25 In Fig. 3, a schematic view of a video graphics generator 206 according to one 

embodiment is shown. The video graphics generator may be an embedded processor 
system, a laptop computer, a desktop computer, or any other means of generating 
video graphics having a predefined repetitive pattern. The video graphic generator may 
even be formed by a counter addressing image information in a memory for outputting 

30 video graphics stored in said memory. However, according to one embodiment the 
video graphics generator 206 may comprise a processor 302, a memory 304, and a 
video signal generator 306. The processor 302 is arranged to process program code 
and video graphics information stored in the memory 304 in order to generate the 
predefined repetitive pattern and the graphics overlay that is to be sent to the video 

35 switch. The processor may be a processor dedicated for the graphic generator or a 
processor of a system in which the graphic generator is embedded. The video signal 
generator 306 provide image fi-ames of the video graphic that are of the same format as 
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the format utilised by the camera and the keying-pattera detector. Moreover, a signal 
carrying the image data of the video graphics is generated and outputted. 

In one embodiment of the video graphics generator 206 the video graphics 
generator 206 may generate a sequence of video images even if the video image in 
5 reality is a still image. Graphics generators capable of generating video graphics in a 
standard digital video format and generating a sigmil carrying the image data of the 
video graphics are well known to persons skilled in the art. 

According to one embodiment the predefined repetitive pattern may be formed 
by image data of at least one non repetitive sub-pattern, this is illustrated in Fig. 4. An 

10 image 402 of the image sequence that is generated by the video graphics generator 

may include a plurality of identical predefined sub-patterns 404 forming the predefined 
repetitive pattern representing the areas of the image 402 that are to be replaced. The 
overlay graphics 406 that are to be visible in a resulting combination may then be 
positioned on top of the repetitive pattern. 

15 The sub-pattern may include as many pixels as one find appropriate for a 

specific application. The sub-pattern may be defined as a specific variation in 
chrominance between the pixels of the sub-pattern, as a specific variation in 
luminance, or as a combination of the two previously mentioned variants. The overlay 
graphics 406 may, as previously mentioned be a date, a time, a logotype, a name, 

20 information regarding settings of the camera or other equipment, other information, 
animated objects or persons/characters, etc, or any combination thereof 

In Figs 5a-d some examples of sub-patterns are shown. Each square in the 
figures represent a pixel and the different fill patterns of the squares indicates different 
values in at least one of the parameters defining the pixels. For example, in Fig 5a the 

25 parameters of the first pixel 422 may be, in RGB notation, 0,0,0 and the parameters of 
the second pfacel 424 may be 255,255,255, or the parameters of the first pbcel 422 may 
be ?,0,? and the parameters of the second pixel may be ?,255,?, the question mark 
indicates that the value of the parameter does not matter. If the parameters of each 
pixel is defined by luminance-chrominance values, the parameters defining the pixels 

30 may for example be, in Y,Cb,Cr, notation, 255,?,? for the first pixel 422 and 0,?,? for 
the second pixel, the question mark indicates that the value of the parameter does not 
matter, or the parameters may for exemfiple be 0,0,0 for the first pixel 422 and 
255,255,255 for the second pixel 424. Any other combination of parameter values may 
be possible as long as the parameter combination for the first pixel 422 is not identical 

35 to the parameter combination of the second pixel 424. As showed in fig 5d, it may also 
be possible to give two pixels within the same sub-pattern identical values as long as 
the sub-pattern may be distinguished fi*om patterns not being a sub-pattern. 
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According to one embodiment the digital video sent from the camera 202 and 
from the video graphics generator 206 in Fig. 2 is defined by luminance-chrominance 
values, Y Cb Cr, and is chroma sub-sampled, i.e. the colour information in each picture 
is sampled at lower spatial resolution than the luminance. The signal may for example 
5 be 4:2:2 chroma sub-sampled, 4: 1 : 1 chroma sub-sampled, 4:2:0 chroma sub-sampled, 
or any other type of chroma sub-sampling. 

In Figs 6a-d, portions of chroma sub-sampled video images are illustrated 
schematically. Each square in the Figs 6a-d correspond to a pixel of the video image. 
In the chroma sub-sampled video images a specific luminance value Y1-Y4 is defined 
10 for each pixel. However, a specific chrominance value, which is defined by the values 
of Cb and Cr, is not defined for each pixel. 

In 4:2:2 chroma sub-sampled video images, see Fig. 6a, one specific Cb value is 
defined for two horizontally consecutive pixels and one specific Cr value is defined for 
two horizontally consecutive pixels. Thus, the chrominance of two such consecutive 
15 pixels, e.g. the ones framed by a thicker line, are identical, i.e. the colour of the two 
pixels are defined by the same chrominance data. Accordingly, a 4:2:2 chroma sub- 
sampled video image essentially contains half the colour information in respect of a 
video image wherein the colour of each specific pixel is defined. 

In 4:1:1 chroma sub-sampled images, see Fig. 6b, the chrominance of four 
20 horizontally consecutive pixels are defined by the same chrominance data, e.g. the ones 
framed by a thicker line. Thus, such video image essentially contains a fourth of the 
colour information in respect of a video image wherein the colour of each specific pixel 
is defined. 

In 4:2:0 chroma sub-sampled video images, see Fig. 6c, the chrominance of 
25 four pixels arranged in a square, e.g. the ones framed by a thicker line, are defined by 
the same chrominance data. Thus, such video image essentially contains a fourth of the 
colour information in respect of a video image wherein the colour of each specific pixel 
is defined. 

As seen in Figs 6a-6c a specific luminance value is, however, defined for each 
30 pixel. The theory behind these sub-sampling methods states that the human eye is more 
sensitive to variations in luminance than in chrominance. 

According to one embodiment of the invention the video images of the video 
image sequence are 4:2:2 chroma sub-sampled and the sub-pattern is defined by means 
of two consecutive pixels, e.g. the pixels including Yl and Y2 in Fig. 6a. In order to 
35 define a pattern the luminance value of the first pixel Yl is defined as a specific value 
Ya and the luminance value of the second pixel is defined as Yp, see Fig. 7. The values 
of the chrominance Cb, Cr in each of the two pixels of the sub-pattern may be any 
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value, because the sub-pattem is only defined by the luminance values Ya and Yp of 
the two pixels of the sub-pattem. 

In embodiments utilising the 4: 1: 1 chroma sub-sampling the sub-pattem of the 
predefined repetitive pattern may be defined in a similar way, e.g. by forming the sub- 
5 pattern in the luminance values Y1-Y4, shown in Fig. 6b. Accordingly, the two 
chrominance values Cb, Cr defining the colour of the four pixels may be set to any 
value in such embodiments. In a similar way may the sub pattern of an embodiment 
utilising the 4:2:0 chroma sub-sampling be defined by the luminance values Y1-Y4 of 
four pixels arranged in a square. For example, the four pixels may be the two first 

10 pixels in the first row of Fig. 6c and the two first pixels in the second row of Fig. 6c. 

As mentioned above, the keying-pattera detector of one embodiment of the 
invention compares data fi-om pbcels sent fi-om the graphics generator with data 
representing a portion of a predefined repetitive pattern. For example, the data fi-om 
the pbcels sent fi^om the graphics generator may be compared with data of a predefined 

15 sub-pattem of the predefined repetitive pattem. Further, the data fi-om the pbcels that 
are compared to the data of the sub-pattem may, for instance, be one or a plurality of 
the RGB parameters defining a pixel or one of or both the luminance and the 
chrominance YcbCr parameters, depending on the coding of the pixels. The 
comparison may be performed in a cyclic manner and in each cycle the comparison 

20 may be performed for a number of pixels that correspond to the number of pixels 
represented in the sub-pattem. According to one embodiment the comparison is 
performed for consecutive blocks of said number of pixels, i.e. a comparison for a pixel 
is only performed once. 

In Fig. 8 one embodiment of a keying-pattem detector 218 of the invention is 

25 shown. The data relating to the pixels sent fi-om the graphics generator are received at 
the video graphics input 452 and data relating to the keying-pattem are present at the 
sub-pattem input 454. The data fi"om the inputs 452, 454, respectively, may be 
compared by means of logic circuitry 456 in order to determine whether the data fi-om 
the video graphics generator are identical to the data of the keying-pattem. The 

30 cx>mparison may be performed by means of logic circuitry implementing an EQUAL- 
fiinction 458, see table below. The EQUAL-fimction may then provide the control 
signal via output 460. 
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There are many ways of implementing the EQUAL-fiinction which are known 
to a person skilled in the art. Therefore, only one embodiment of such an 
implementation is described below, see Fig 9. Each bit 462-468 of the data from the 
video graphics generator that are to be compared with the keying-pattem is tested 
5 against each corresponding bit 472-478 of the kejdng-pattem by means of an XOR- 
gate 482-488 (exclusive or gate). The number of bits in the keying-pattem and, thus, 
the number of bits in the data from the video graphics generator that are to be tested 
against the keying-pattem depends on the number of pixels from the graphics 
generator that are to be tested in each detection cycle, the number of parameters to test 

10 for each pixel, and the number of bits in each parameter to test. 

For example, in a two pixel keying-pattem, i.e. two pixels at a time is compzu^ed 
to the keying-pattem, that only relates two the luminance of a 4:2:2 chroma sub- 
sampled video image and in which video image, and keying-pattem, each luminance 
value is represented by eight bits, the number of bits in the keying-pattem and the 

15 video image, respectively, to test each time is sixteen, i.e. the keying-pattem consists 

Truth table for the EQUAL function 458 



Video 


Sub- 


control 


graphics 


pattern 


signal 


input 452 


input 454 


output 460 


0 


0 


1 


0 


1 


0 


1 


0 


0 


1 


1 


1 



of sixteen bits and the data to test consists of sixteen bits. 

When each bit of the data of the video image has been tested against each bit of 
the keying-pattem in the XOR-gates 482-488, the resulting signal 492-498 of each 
XOR-gate 482-488 may be tested against all other resulting signals 492-498 of the 

20 other XOR-gates 482-488 in a final NOR-operation, which is illustrated by the NOR- 
gate 500. Accordingly, if the data 452 from the video graphics generator corresponds 
to the data 454 of the keying-pattem, all the resulting signals 492-498 will all 
correspond to a state "0" and, thus, the final NOR-operation 500 will result in a 
control signal 460 corresponding to the state "1". If one or a plurality of bits of the 

25 data 452 from the video graphics generator do not correspond to the corresponding 
bits of the keying-pattem, one or a plurality of the resulting signals 492-498 will 
correspond to a state "1" and, thus, the NOR-operation 500 will result in a control 
signal 460 corresponding to the state "0". This resulting signal may then be provided 
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to the switch for controlling whether the portion of the signal from the video graphics 
generator that includes the data that was tested are to be forwarded by the switch or 
not. In the example above a control signal corresponding to the state "1" makes the 
switch forward the signal from the graphics generator whereas a control signal 
5 corresponding to state "0" makes the switch forward the signal from the camera. 

In Fig. 8 the keying-pattem is provided to the keying-pattem detector by means 
of a signal line or a data bus external to the keying-pattem detector 218. In such an 
implementation the keying-pattem may be stored in a memory of the device including 
the keying-pattem detector 218. However, the keying-pattem may also be stored or 

10 hard coded into the keying-pattem detector 218. 

In Fig. 10 an embodiment of the invention is described. In the embodiment the 
kejdng-pattem detector 218 and the video switch 1 10 is arranged in a video combining 
device 210. Further, the images of the image sequence from the camera and the images 
from the graphics generator are 4:2:2 chroma sub-sampled. Thus, two pixels of said 

15 images are represented by means of the parameters Yl, which represents the luminance 
value of the first pixel of the two pixels, Y2, which represents the luminance value of 
the second pixel of the two pixels, Cb and Cr, which together define the colour of said 
two pixels. In the text hereinafter, such two pixels are related to as a pair of pixels. 
The camera video signal 212 is received at a first input 512 of the video 

20 combining device 210 and the graphics video signal 214 is received at a second 

input 514 of the video combining device 210. The image sequences of the two video 
signals may be synchronised in respect of the image frames and pixels of said image 
sequences, i.e. a pair of pixels of the camera video signal 212 and a corresponding, in 
respect of position within an image, pair of pixels of the graphics video signal 214 are 

25 in position to be forwarded by the video switch 1 10 at essentially the same time. If the 
video signals are not synchronised when received at the inputs 512, 514, then the video 
combining device may be arranged to synchronise the signals. 

The keying-pattem detector receives luminance data corresponding to the 
luminance Yl, Y2 of one pair of pixels at a time, step 520. The bits of the luminance 

30 data are compared with the bits of a keying-pattem that is inputted to the keying- 
pattem detector 218 via input 516 or which may be present in the detector 218, step 
522. The keying-pattem correspond to a sub-pattern of the predefined repetitive 
pattem. If the luminance data correspond to the keying-pattem then the control 
signal 220 is set to a state corresponding to a state 'T', step 524. If the luminance data 

35 do not correspond to the keying-pattem then the control signal 220 is set to a state 

corresponding to the state "1", step 526. Then, the keying-pattem detector 218 starts a 
new cycle, step 528, by receiving the luminance data of the next pair of pixels. 
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The control signal 220 is received by the video switch 1 10. If the control signal 
indicates the state "1*', the video switch 1 10 forwards the portion of the graphics video 
signal corresponding to the two pixels to which the luminance values Yl, Y2 tested by 
the keying-pattem detector belong, and if the control signal indicates the state ''O", the 
5 video switch 110 forwards the portion of the camera video signal corresponding, in 
regard of position within an image, to said pair of pixels of the graphics video signal. 

Accordingly, the images represented by the resulting video signal 216, 
outputted from the video switch 1 10, do not include any portions of the graphics video 
signal having luminance parameters Yl, Y2 that are identical to the keying-pattem, 
10 because the video switch 110 forwards the corresponding camera video signal when 
such portions are present. 
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